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ABSTBACT . 

This paper presents arguments in favor of using 
partial dictation as a test of foreign language proficiency. In this 
kind of test, subjects listen to recordings of laterial in the 
foreign language and are required to fill in aissing words in a 
written version of the recordings. Partial dictation is preferable to 
ordinary dictation in that; (1) it aakes possible the use of 
different voices and speech situations; (2) it is aore econoaical; 
and (3) the testing situation is aore natural, being subject to fewer 
interruptions. In addition, partial dictation appears to be reliable 
and to correspond very well to other aeasures of foreign language 
proficiency: it is easy to construct, adainister, and score; and it 
is useful, not only as a aeasure of listening coaprehension, but as a 
global estiaate of language proficiency. An incoaplete analysis is 
presented of errors found in connection with this test, on the levels 
of phonology, lexicology, and graaaar. Appendices contain two saaple 
passages used in a partial dictation test, and a listing of average 
scores for each itea, froa a randoa saapling of 20 subjects. 
(Author/ AM) 



♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦♦^ff* **************** ******♦♦♦♦♦♦♦♦♦*♦♦♦♦♦♦*♦ 

* Docuaents acquired bf EBIC include aany inforaal unpublished 

* aaterials not availablef froa other sources. EBIC aakes every effort 

* to obtain the best copi available, nevertheless, iteas of aarginal 

* reproducibility are o£4m encountered an< this affects the quality 

* of the aicrofiche and hafrdcopy reproductions EBIC aakes available 

* via the EBIC Docuaent fieproduction Service (EDBS) . EDBS is not 

* responsible for the quality of the original docuaent. Beproductions 

* supplied by EDBS are the best that can be aade froa the original. 
»»♦♦♦♦»»♦*************************♦*****♦**♦*♦******♦♦♦♦♦♦♦♦♦♦♦**♦♦♦♦♦ 



ERIC 



US OEPAHTMENTO^ HEALTH. 
EDUCATION a MEL^AEE 
NATIONAL INSTITUTE O^ 
EDUCATION 

TMtS DOCUMENT MAS BEEN «E«»«0- 
OUCFO FXACTLY AS RECEJVEO F«OM 
THE PfftSON 0» 0»0ANt2AT»0N 0«(OlN* 
ATiNG IT POINTS OP VJEW OR OPINIONS 
STATFO 00 NOT NECeSSA«»LV REPRE- 
SENTCr^iCiAi NATIONAL »NSTlTUTEO^ 
EOUCATiON POSITION 0« POl»CV 



Swedinh-Kngl i Gh Contractive Studies 



1 artirJ c t H 'uj 01 i a Tect o f 
Fo7' oj ^ Lar!^UB^: e Iroiicleuc y 

stir: Johar!>is'^n 



PrRMi ,S!ON lO REPRODncE THIS 
M,.TU'iA' HA'. HbtN OHANTFOBY 



Jan Svartik 



jr t .f ".lA ih j-^^ ftrvTtP ftKM(. ( AND 



COKTiiNTS 



:ric 



l-age 



1 AIM 

2 BACKGROUND 2 

2.1 Dictation 2 

2.2 The cloze technique 5 

3 PARTIAL DICTATION ^ 9 

3.1 Reliability -9 
3.2^ - Validity ._ 10~ 

3.3 Construction and administration ^ 12 

3.4 Scoring system 14 

4 ERROR ANALYSIS . 18 
4. I Types of errors in partial dictation 18 
4.1.1 Phoneme errors 18 

4.1.1.1 Omission 19 
4.1.1.? Substitution 20 
4.1.1.3 Addition ?^ 
4*1.1.4 Reordering 24 
4.1.? Lexical errors . ' 25 
4.1.P.1 Omission 25 

4.1.2.2 Substitution 26 

4.1.2.3 Addition 28 
4.1.3 Grammatical errors 28 

4.1.3.1 Segmentation ?6 

4.1.3.2 Reordering 30 
4.1.3*3 Restructuring 31 

4.1.3.4 Morphology 33 
4.1.3*5 Function words 35 

4.2 Levels of oompreheTision 36 

4.3 The lin/;uistic evidence of com/ rehension 3^' 
errors 

5 WHAT WKZ J ARTIAL JjJCTATluIi K^-IaGURj':'. 40 
i;OT£S 43, ^ 

Ai J r:\/lA 1 : The tert 50 
/>M'i'J,.''A : Di:^.c: jurnina lion uf ter.l i trrnr 



3 



c. 



\ 



1 



1 AIM 

In this paper arguments will be presented in favour 
of using partial dictation as a test of foreign 
language proficiency. In partial dictations test 
subjects listen to recordings of material in the 
foreign language and are required to fill in missing 
. words in a written version of the recordings. It 
will be shown that such tes^s are reliable and 
correspond very well to other measures of foreign 
language proficiency and that they are, in addition, 
easy to construct, administer and score. The pejer 
includes a classification of errors in a partial 
dictation. 
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BACKGROUND 

Partial dictations are closely related to two other 
types of tests which have been used to measure foreign 

langua^^e proficiency: dictation and cloze tests. We , 
s}iall discuss the use of partial dictation against 
the background of "^hese testing techniques in order 
to (l) clarify the theoretical background of partial 
dictation, and (2) bring out the advantages of par- 
tial dictation over ordinary dictation and tests 
based on the cloze technique* 

?. 1 MCT4TI0N 

In ordinary dictation the teacher reads out passages 
in the foreign language and students are required 
to write them dc m. Valette (1967, P* 140) recommends 
the following technique in administering a dicta- 
tion: 

First, \.ne whole passage is read at rorme^l speeds 
The students are told not to write, jlist to 
listen carefully. Then the passage is read 
a phrase at a time, with pauses during which 
the students write down what they have heard. 
At this time the teacher may read each phrase 
either once or tv/ice, as long as he is consis- 
tent ... Finally, the entire passage is read 
again at normal speed, ond the students are 
given a few minutes for final revision. It 
is imperatJve that the teacher never repeat 
a particular phrase at a student's request. 
Valette (1:J67, p. 139) reports that dictation scores 
correlate very well with overall languaf,c acliieve- 
m^nt an*] I'efern to an earlier study on the^ subject 
(Valcti-c ry.4). In a rec-nt article Oiler (l';7l) 
haf; furthfr d^Mhon., tr^' t<:d 1 fio j-euiai-k;}bl y hjgh corrcla- 
tioii ^'f-'tween peorcs m dictationri avA other tests of 
forcJ,',n ] rii\/\iii!u-' jn-o I 1 0 j cMicy • After examjninr, a 
tost oon::intjnr of five ]>arts (vocabulary, ^r.uumar. 




composition, phonology an^ dictation), Oiler con- 
cludes: 

It was discovered that the dictation correlated 
more highly with each other part of the test 
than did any other part. (p. 254) >^ 

♦ In short, the dictation clearly seems to be ' 
the best single measure bf the totality of 
English-language skills being tested, (p. 255) 
The porr^3Pondence between scores in dictations and 
other tests is not surprising^ if^ we consider the 
■process of speech perception-; This has been con- 
vincingly argued by Oiler (l97l). In recent accour^t 
of speech perception if is generally emphasized ve^y 
strongly that the decoding of a spoken message is 
an £^ctive process in whii^h the listener utilizes 
his knowledge of ail aspects of the language system. 
Cf. the summary of the operations involved in speech 
decoding in Pry (1970, p, 51 f . ) : 

1. Incoming acou:tic information is processed 
by the acoustic decoding mechanism which works 
on a complex of cues appearing in the output. 
?. Knowledge of the phonological constraints 
is combined v/ith the results of acoustic pro- 
cessing; only a restricted set of phonemes is 
possible at any position. 

3. The phoneme string is predicted on the 
basis of the items which are most probable 
^acoustically and linguistically. 

4. The phoneme string is segmented into mor- 
pheme- by reference to knowledge of morpheme- 
forming rulen. 

5* Morpheme constraints arc applied and mor- 
phemes identified by matching with the store 
of free and bound morphemes, beginning with 
the Hior.t ja'obablo item. 

6, Tlie morpheme string is fanned into wordt; 
matckicd with Irxjoal itemr> in the store, the 
choice bein/- re.-tricted by sequential depen- 
dencies. 



7. The word sequence is formed which satisfies- 
all syntactic and semantic constraints. 
Fry points out that the J'steps are inevitably set 
out one after the other but it is important to 
remember that they represent parallel processes 
with the very minimum of * real time* lag between 
any level and the next immediately below" (p. 51 )• 
The fact that the listener utilizes' his knowledge on 
all levels of the language ir, clearly borne out T)y 
an examination of errors in partial dictations • (cf* 
Section 4). 

Ordinary dictation is especially suitable as a 
t^^st for beginning students. On more advanced levels 
the technique must be modified. Spolsky et al. (1968) 
suggested the use' of different levels of white noise 
in a dictation test containing a series of isolated 
sentencc3. However, it has recently been shown 
(Johanc-on 1973) tnat performance in such a test may 
not be a true reflection of the ability to function 
in more realistic situations. Another way of modl- 
fyirg the testing technique is to concentrate the 
dictatiOT) to especially selected portions of the 
text, i.e. to use partial dictation. Partial dicta- 
tion, as defined in this I5aper, also differs from 
ordinary dictation in the following respects: 

a) The passages presented for dictation are 
played from a tape-recorder, not read 
out by the teacher. ^ 

b) Students listen to the recordings, only once. 
Partial dictation is preferable to ordinary 

dictation in several respects. Since the passages 
to be written down are played from a tape-^recorder , 
it iG possible to use a variety of different voices 
and L^poech situations (recordings in different dia*- 
loots and registers). Above all, partial dictation 
x\\ n.oru economical, since it can be administered more 
rapidly than ordinary dictation and can bo conccn- 
tr^ji^vj on j-roblcin rireas in the text. Finally, the 



testing situation in partial dictation seems to be 
more natural, since the passages heard are not in- / 
terrupted as often as in ordinary dictation. 

2.2 THE CLOZE TECHNIQUE 

The cloze technique was- ori'ginally introduced' as. 
a means of measuring the readability Qf texts (Tay.lor 
1953)- In cloze tests' every nth word in a sample . ' 
of a text is. deleted and replaced by blank, and." 
test subjects are asked to Till- in the. missing word. 
The soore of a group of subjects is taken as a 
measure of ^he readability of the text. The cloze' 
technique was later extended to* the measurement of 
reading comprehension in the native,- language. 
The «ct)re of individual test subjects is then 
taken as an estimate of their reading comprehension 
ability. Cloze tests have also occasionally been 
presented in auditory form £n order to measure 
listening comprehension in the native language (e.g. 
i^eisach 1965). More recently, a number of, studies 
have dealt with the use of the cloze technique in 
measuring foreign language proficiency. A survey 
of cloze test research is given in Oll^r (1972). 

As reported by Oiler (1972), the cloze technique 
appears to be extremely' useful in Pleasuring foreign 
langua;^e proficiency. Studies of cloze- tests have 
yielded inipres^Uve reliabilities and item analysis 
results (Oiler, op.cit., p. 13). High correlations 
have been found between scores in (written) cloze 
tests and other measures of foreign language pro- 
ficiency (Oiler, op.cit., p. 14). It is interesting 
to note that the highest correlations have been found 
with teste of listening comprehension, including 
dictation. Th.^ s may oeem surprising, since the 

mode of presentation is completely different in 

I? 

the two testing situations ami appears to make 
difforonl demnnds on test subjects: 



for one thing, phonology is presumably an 
important factor in listening comprehension 
though it should not be a significant factor 
in taking a cloze test. For another, it is 
frequently assumed that written tests allow 
unlimited time for processing whereas orally 
presented materials invoke short-term memory 
* constraints. (Oiler, op.cit/, p. 20)' • ' 

Oiler attempts 'to explain the remarkable correspon- 
dence between the two types of tests by referring 
to a "granmiar of expectancy" as^ "the chief mechanism^ 
underlying the skills pf thijjking, understanding, 
speaking; reading and writing" (p. 18). Listrn^ng 
and reading — and filling in blanks in cloze tests 
are process^es which require 'a cooperation between ' 
the productive and' rec.ep,tive skills of language: 
The information provided ,in the cloz^e test 
allows the srtudent by :analysis' to synthesize, 
a. greatrr whole . . ■ By sampling the inf orma- . 
tion that is pr^esent the subject formulates 
hypotheses or .expectations , about information! * 
that is to. fdllowe By sampling -subsequent 
sequences, he either confirms or disconfirms 
these expectations. If the expectations are 
disco'nf irmed they must^ be reviser/ and new ' 
hypotheses must be formed. (Oiler, op.oit.,' 

p. 19) . ' - 

The hypatheses are formed on the basis of tTie - , 
available information and tne test subject ' s know- 
ledge of the language.' Compare the account ^of 
speech perception in Fry (l970): 

When we take in a spoken message ,^ it is 
necessary for our ears to receive sound- 
waves originating with the speaker ... 
Thonc L'ound -waves and the information that 
the brain is able to extract from thera form 
no more than a- rough f^uide to the cense of 
the maiMirirc, a kind of scaffold Lng upou 



r which tno listener constructs or rjeconstruc ts 
\ the sentences originating in the sjpeaker's 



tests and tests of listening comprehension which 
accounts for the high correlations found by several 
investigators. 

Cloze tests and tests of listening comprehension, 
including dictation, appear to measure basically the 
same ability in test subjects. There is, however, 
an important limitation of the cloze technique. Car- 
roll (197?, P- lb) points out that cloze scores are 
chiefly dependent on the "local redundancy" of a 
passage, i.e. "the extent to which linguistic cues 
in the immediate environment (generally, in the same 
sentence) uf a missing word tend to supply it". He 
reports further that it is "even possible to secure 
cloze scores on the basis of meaningless material 
so long as grammatical cues are present" (p. 19). 
A possible way of overcoming the "local redundancy" 
problem would be to introduce multiple word deletions. 
In this case the restoration of the missing elements 
would have to rely much more on the comprehension of 
the whole text. Oiler (197?, p. 6); mentions the possi- 
bility of using n:ultiplc word deletions but states 
that this variation of the cloze technique has not 
been investigated. 

Let us now examine partial dictation against 
the br.ekground of the above account oOf the clor.e 
technique. Partial dictations are similar to cloze 
testr. in the sontie that students are provided with 




It is this liigh-level correspondence beliween cloze 
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a written text *?ith blanks to be filled m.^ There 
are, however, some important differences: 

a) Multiple word deletions are normal in 
partial dictation, as defined in this 
paper. 

b) The students listen to the whole text, 
including the missing portions. 

By using multiple word deletions, the "local redun- 
dancy" problem referred to above is solved. By 
letting the students listen to the text we can be 
sure that we measure comprehension proper, not in- 
ferential processes.'' It might be objected (l) that 
the test becomes too easy, and (2) that we test a 
purely passive skill in this way However, it is 
passible to increase the level of difficulty 01 the 
test by choosing recordings in an unfamiliar dialect 
or containing difficult words and constructions or 
recorded with a high speed of delivery. Moreover, 
we hope to have demonstrated already that aural 
perception is not a passive skill but involves the 
active use of all aspects of the language system. 



PARTIAL DICTATION 

Pctrtial dictation is certainly not a new xechnique. 
It has been recommended as a useful exercise (e.g. 
Black 1969»34?) and has probably been used by many 
foreign language teachers. Valette (1967) mentions 
partial dictation as a language proficiency test, 
although she restricts the portions tq be filled in 
by the student to "function words, or often merely 
prefixes or endings" (p. 139). There does not appear 
to be any detailed account of partial dictation, as 
defined in this paper, in the literature. This 
paper ^s based on a close investigation of a partial 
dictation administered recently at the Department 
of English, und University, Sweden.- , A description 
of the test, which consisted of two separate passages 
of English text, appears in Appejidix 1. - 

3.1 RELIABILITY 

The reliability of partial dictations appears to be 
very high. A product-moment correlation of W^s. 
found between the scores in the first and second 
passages of the test described in this paper! The 
figure is based on the scores of all (80) partici- 
pants in the test- The correlation is remarkably 
high considering the fact, that the two passages (D1 
and D2) differ in at least three respects: 

a) D1 was constructed according to procedure II, 
D2 according to procedure I (cf. Section 3.3'^. 

b) Dl was recorded by a native speaker of 
American English (Inland Northern). The 
speaker's pronunciation in 13? v;a3 topically 

, British (iieceived Pronunciation). The Ameri- 
can speaker wan female, the British speaker 
male. 

c) Dl was undistorted but was recorded with a 

1 '> 



very high speed of delivery The speed of 
delivery was lower in D2 ; on the other hand, 
there were slight disturbances on the tape. 
D? was taken from a British radio pgrogranune. 
The high correlation between scores in D1 N^nd D2 
further illustrates the fact that comprehension is 
largely independent of the mode of presentation of 
a toot (cf. Section ?.?). A practical conclusion 
that could be drawn from this rcr that exer- 

ciser? in listening comprehension should concentrate 
more on higher levels of language structure than on 
phono iOgy, * * , 

3.? VALIDITY 

In an envly experiment (see Johansson 1973) high 
correlations v/ere found between a partial dictation 
and tv/o other types -of tester a test in gra^ninar and 
vocabulary (.70) and a listening comprehension test 
con::isting of questions on a recorded text (.83), 
The scores of ?0 randomly^ selected students tatcing 
the test described in this paper v^ere compared with 
scores in the following tests: 

a) A test of English vocabulary consisting of 120 
multiple-choice items. .The student has to 
-choose the correct Swedish tratislation from 
ainon,- five alternatives presented. The 2ng- 

V "^lish v/ords are chosen on the basis of c wora 
frequency list. 

b) A test of English gramrriar consisting of 100 
multiple-choice items. Each item consists 
of an isoJated English sentence containing 

a /^,ra:nmatical choicr^ situation. ' The student 
)ias to choose the correct alternative from 
ainon^: Wo or three presented. 

c) A t^^st or Kn-lish pronunciation conducted in 
a JanrMuro I /iboivitory . The ntudont has to 
rf/ad (l) a serie:> of v/ordn and scnt^noos 



testing different phonemic contrasts and 
(2) a series of words and phra5?es designed 
to test the pronunciation of individual 
lexical items. Test items are chosen on 
the basis of a word frequency list. 

d) A test of Swedish vocabulary consisting of 
100 multiple-choice items. The student has 
to choose the closest Swedish synonym or 
definition from among five alternatives 
presented. The te^ items are selected on 
the basis of a word frequency list. 

e) A speaking test conducted in the language 
laboratory. The student has to re-tell a 
story and describe a series of pictures. 
The number of *5»rious mistakes in grammar 
and vocabulary constitutes the score in the 
test.^' (The correlation in this cane is 
calculated on the basis of the scores of 
the total number of students, 36, taking 
part in the test. ) 

The following product-moment correlations were 
computed ; 

English pri-li^h 

English vocabulary '"q;!;^^!!! Swedish Speaking 
vocaDuiarv + English vocabulary test 

grammar ^lation ^ (English) 

.80 .86 , .78 .65 .62 

The results should be compared with the figures 
reported by Oiler (1971). The rather high correla- 
tion between partial dictation and the tef;t in 
Swedish vocabulary may seem surprising. On the 
other hand, the correlation between the latter test 
and the English grammar test was still higher (.70). 
Thf* corrospondr^nce indicates that there in a rela-* 
tionnha ]) butv^'jen native^ ard ror-olgn language pro- 
ficiency. ^ ' ' ^ 
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Valette (l964) concludes that 'dictation is 
a valid test of overall language skills only for 
students with little practice in dictation and 
that emphasis on such practice develops proficiency 
in that skill alone without leading to proportional 
proficiency in other aspects of language learning. 
We have not been able to establish whether this 
is also true of partial dictation, since all the 
students taking part in our tests have had com- 
paratively little practice* This possible limita- 
tion of the testin^; technique should, however , be 
kept in mind. 

3.3 COK3TRUGTI0K AND ADMINISTRATION 

The procedure for constructing partia,l dictations 
is fairly simple. There are two possible ways of 
doing it, 

I r) Use a recording as a starting-point, e»g. 

from a radio or television programme. 
. , b) Make a written version of the recording. 

c) Decide what portions should be left out 
in the student's answer sheet. 

d) Insert pauses in the recording for each 
missing portion in the text. 

II a) Select a suitable text to be recorded. 

b) Have the text recorded by a native speaker 
of the language.^ 

c) Decide what portions should be left out 
in the student's answer sheet. 

d) Jnr»ert pauses in the recording for each 
iiiinsinf; portion in the text. 

A 1 ' rn.'livr' IJ v/Cir un^^d in l}io first p.'insafM:^ of tlie 
ter.t .'rriy-.rd in thi.: paper, a] icj-native 1 in the* 



- We shall not deal with all the problems in^- 
volved in finding the suitable level of difficulty 
of the tcxt/recordinc uaed as starting-point. This 
wi]l obviounly have to vary depending on the level 
of proficiency of the group of students which the 
test is designed for. The test described in this 
paper v/as designed for Swedish university students 
of English, and the degree of difficulty is conse- 
quently high. 

The most important step in constructing the 
test is deciding what portions should be left out 
in the written version of the recording appearing 
in the student's answer sheet. Earlier experiments 
have shown that, if possible, portions should be 
left out immediately preceding a possible pause. 
Usually, students have been asked to fill in missing 
words at the end of clauses or sentences. The length 
of the missing portions may vary depending on the 
possibilities offered by the text. It remains to 
be established if there is an optimal length. '^^ 'In 
the test described in this paper the number of words 
left out in each case vai-ies between 10 and ?. An 
ex^i:i;ino tiun o[ the results for the different test 
items shows that they only very rarely failed to 
discriminate between the top and the lower half of 
a groiJ]^ of ?0 rrmdomJ y rreiec ted students ( see 
Appendix ?). In no case did' the to]) half receive 
a lower avei'a^.e score than the lo-.ver half. 

Inserting pauses in tlie recordings involves no 
particular pmbjem. Since the length of the missing 
I)Ortions vari cc , no staiiiiard pause length can be 
used* It deserves to be i^ointed out that the pause 
mu::t follow imrnodiately aftei' tlu? missing portion in 
the ipxt, Ter:t i ic^ms of the following kind have been 
founJ to b(' uiKia ti sf actoi-y ( the words to bo filled in' 
by th*^^ stud on t are unii^r 1 i ned ; the? 1 ocation of the 
paur.e m the jfcorduv: is indicat^^d by //): 
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Britain has the faster,! rinin^^ cost of 
livj^"/' of any other country in the world.// 
At this moment, Richard Nixon stands 
witliji? an ace of victory in the 1968 
presidentjal election.// 

In cases like these students appeared to have great 
difficulty m remembering which words they had to 
fill in. Omiaoions were also especially frequent 
in teat items of this kind. If there has to be a 
minsirig portion in the middle of a sentence, it 
mu3t therefore be immediately followed by a pause, 

Britain has the fastest risinp:Ccost of 
livia^ // of any other country in the 
world . 

At this moment, Richard Nixon stands 
within an ace of victory // in the 1868 
presidential election. 

Even thouf^h iheite is a break in the middle of the 
sentence, test items of the latter kind have woriced 
satisfactorily. ^ 

The administration of the test should preferably 
be carried out in a lan^^Ucage laboratory in order to 
ensure equal listening conditions for all partici- ' 
pants If many groups of students have to take 

the same test,, it is advisable to construct several ^ 
passaf^os for partial dictation and select a different 
combination of passages for each successive group. 
This ivs por.Gible because of the* high correlation 
betwf^en partial dictations based on different texts 
(c f • l^ecti on 3.1). 

GYrjTi;yi 



The ticorin.: s:/:Uein uiiod so far in our partial djctati 
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hac been very simple: 1 point per correct wordj^ 
In order to minimize the importance of spelling, 
certain spelling errors have been disregarded. The 
guiding principle has been to disregard errors which 
would not affect pronunciation, provided that the 
word is clearly recognizable and distinct from other 
words with a similar spelling. Examples: 



stTVC n i np 


± U L 






for 


poi soned 


r P I) P R t P 


f* n 

± yj L 


'T' O O i> "t" 


lie/. V/ A CLJ. i. o U 


'1^ n T* 
X u L 


lid 0 Urci± 1 b 1/ 


oT^o/^ T mom 
O^Jc L. d iJidll 


for 


specimen 


p p. s i 0 n a 1 1 y 


for 


passionately 


stragp:elin^^ 


for 


straggling 


exibits 


for 


exhibits 


telesccpi que 


for 


telescoi^io 


rif els 


for 


ri f les 


amunitioij 


for 


animuni tion 


bli zards 


for 


blizzards 


convays 


for 


conveys 


elequence 


for 


eloauence 


lit terary 


for 


li terary 


reasbnibly 


for 


reasonably 


sentimenLel 


for 


sentimer ta] 


frocsen 


for 


frozen 



On the other hand, words 
fGl]ov;inf^ kind have been 



containing errors of the 
marked as incorrect : 



stri ckney 


for 


strychnine 


sppcimcnt 


for 


specimen 


repi t 


for 


rejK^at 


for pans 


for 


f n] conn 




for 






for 


iKi^^r. i onatoly 


exppi t 


for 
for 


exh L bi t 


epu.'il 1 y 


0(\u:i 1 j y 



TTJ 



hear 


for 


here 


rifals 


for 


rifles 


amlnition 


for 


ammunition 


blizers 


for 


blizzards 


exitment 


for 


excitement 


allequence 


for 


eloQuence 


tempi tures 


for 


temperatures 


capiture 


for 


capture 


inaxerable 


for 


inexorable 


where 


for 


were 



In doubtful cases, there has been a tendency to reject 
frequent words containing spelling errors, whereas 
the range of accepted spellings has been slightly 
greater foi- more unusual words. Words containijig 
the wrong derivational or inflexional ending have 
always been marked as incorrect. 

There is no dcubt that the scoring system" could 
be improved considerably, if the degree of accepta- 
bility of student responses is taken into account. . 
'Consider, for example, errors of the following kind:^ 



inexorable 



inexable 

in extra 

an extra board 

inevitable 



lodger-space 



iLegislatas 
leggaspace 
leisure space 
living--space 

It would be desirable to reward syntactic and/or 
semantic compatibility of student responses (e.g. 
inevitable and livin/^-space ) as against omissions 
or responses which merely seem to reflect a vague 
phono] o;'.ical impression; cf . the discunsion' in 
Section 4.2 as regards incorrect responses of 
studentG with a higher versus lower scored in the - 
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test. Grading the degree of acceptability of 
responses would, however, make the scoring far 
more difficult and probably also introduce a greater 
amount of subjectivity into the test. In view of 
the satisfactory results obtained with the present 
scoring system (cf. above), a change appears to be 
unnecessary. ^ 



ERROR ANALYSIS 

Error analysis is currently a very active field of 
applied lineuistics. However, the analysis is 
generally limited to the investigation of errors 
in written and spoken production. Errors in per- 
ception have only occasionally been dealt with,''^ 
no doubt due to the problems involved in the testing 
of listening comprehension. We shall give a brief 
and incomplete account of errors in the test des- 
cribed in this paper in order to (l) further illus- 
trate what is being tested in partial dictation and 
(2) demonstrate how such an analysis may reveal per- 
ception problems aiaong learners with a particular 
language background (in this case, Swedes learning 
English) as well as throw light on general aspects 
of speech perception J The error analysis is based 
on thB responses of 80 students. 

4.1 TY1^E3 OF ERRORS IN PARTIAL DICTATION 

Errors in partial dictations may be classified in 
various ways. An obvious basis of classification 
is to group errors according to type of deviation 
from the text: omissions, additions, reorderings, 
substitutions, etc. Another possible alternative 
is to classify them accorciing to the presumed psycho- 
logical mechanisms involved: anticipation errors, 
perseverance errors, etc. The primary d^assif ication 
chonen here is based on the level of linguistic 
';Structure which the error may be referred to: phono- 
logy, lexicology and grammar. 

4.1.1 rhon(3me errors 

In cx;:iJiiixiin/; i)honeme errors it is important to boar 
in mind iiiut- r>uch error^> can only be inferred in- 
directly' from the often uncortainj evJ dcnce affordod 
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by spelling. We shall limit the discussion to 
reasonably clear cases. The following types will 
be distinguished: errors of omission, substitution, 
addition and reordering. 
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4.1.1.1 Omission 

Omissions, as well as other types of phonemic errors, 
seem to be especially frequent in unstressed syllables 
A few examples may suffice to illustrate the point: 



inexabl^ 


for 


inexorable 


purnent 


for 


pertinent 


rescenly 


^ for 


reasonably 


telescopy 


for 


telescopic 


passionly 


for 


passionately 


- strickney 


for 


strychnine 



One case of omission, which occurred repeatedly i.n 
stressed as well as unstressed^, syllables , should be 
noted in particular, i»e. the omission of /r/. 
Examples (types and tokens): 



passier , passur etg, ( 1 ?) 

passage ( 10) 

tempitures (2 ) 

ifiexable , inaxable etc. (5) 

stickny r sti qwin etc. (8) 

couw 

ruel, rule etc. (7) 
cool , coolty etc.(l ^ 
micomlje , micion 



for pressure 
for pressure 
for temperatures 
for inexorable 
for strychnine 
for crow 
for rural 
for Cruelty 
for migrant 



The following errorc should possibly also be inter-- 
preted an involving omission of /r/: 

purpose (?) for propor.r 

p Mrvidin/; (?) for provjdJm^ 

' ^ It should al r.Q bo mentioned tb.-jt final /t 

2 



representing the endings '-{e)s and -ed were frequently 
omitted. This may in part -be a sign of grammatical 
weakness and will be dealt with in Section 4.1.5.4. 

4.1.1.? Substitution 

Substitutions form the most frequent type of phonemic 
error. Like omissions they are especially frequent 
in unstressed syllables^ Examples: 

advorose for admiral' s 

legislates for ledger-space 

westv/an for westward 

inextrabur for inexorable 

ervin^ * for urban 

purti runt for pertinent 

In order to limit the material we shall mainly deal 
with substitutions ^in stressed syllables. We shall 
only* consider types of substitution which appear in 
several test words or appear frequently in one par- 
ticular test word. For a summary of consonant and 
vowel substitutions, see Tables 1 and 2. (pp. 22-23) 
Apart from the substitutions summarized in the 
tables, the following cases are of special interest: 
a) the substitution of a back rounded vowel for 
dark /?/, as evidenced by: 

an extra bow , un extraroad , 

an extra board , an extra boarn , 

an extra bone , an extrabow for inexorable 

The following exampae seems to show the opposite 
tendency, i.e. the insertion of /I/ in place of 
or next to ,a back rounded vowel: 

fuel:- (5), fb^-ls (b), 

iHlli' ^^'''^ for fuse 

^b) th- r.wb::ti tution of nar>a3 *f homor/u-mic r^top for 
a crrnhi n-iti on of naaal ^ homor/^onlo atop with 
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another place of articulation: 
intrigated . insticated . 

indicnated , indicated for impregnated 

contemporal , contempious for potential 

mlcombe fot migrant 

Notice also the substitution of a nasal homor-- 
gantc with a following stop in: 

secund , secound for succumbed 

In this case the change of articulatipn results 
from a failure to assign a correct morrphemic 
analysis* 

In the passage read by the American jsnglish 
speaker the following additional substitutions are 
worth noticing: f 

i 

a) A final unreleased /p/ was interpref;ed as a 
/b/ in^ 

stumb (?)■, stamb (2), slumb for' stump 

An isolated instance Of stum was also found. 

b) Voiced / t/ was interpreted as a /d^ in: 

shoud , shud and- various other | 
responses (l4) containing /d/ fdjc shot 

I 

Most of the substitutions dealt wijth appear to 
be independent of neighbouring sounds, f They might 
be termed paradigmatic substitutions. jClear examples 

Of syntagmatic substitutions are infrequent: 

f 

chapture , chapter for capture 

distant short ( 1 ) , " I 

distance shores (7) f|)r distant shores 

Krrors of thic kind are related to thn tyi)e of error 
to bo dincuncred in Secti on \4 . 1 • 1 * 4 . ! 
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Table 1 . Consonant substitutions 



Consonant 
contrast 


Test word 


Student responses 
(types aiid tokens) 


Ivl 


- Ul 


vast 

conveys , 
eloquence 


waist , western , waste , 
worst (2) , wast 

conwaised, conweist 

elekvents 


/r/ 


- 1^1 


westward 
rifles V-*" 
run out of 


westrode * 
wifels 
awan with 


/s/ 




conveys 

blizzards 
reasonably 


convest (2), convinced 
(2), conveiced, con- 
weist, conviced (5) » 
convessed v^;, con 
vaiced, conveyced, con- 
vace, convainced, con- 
V p i Q t CO n v ai s t • c o n^* 
vaced, convast 

blassets, blisters, 
blessives 

recently, rescently 






ill O 


this (^) 




*■ 


shores 
sends' 


source, sauce, chource 
sents 


/s/ 


- /tf/ 




TDparched (7) • pitr»^*^d 


/s/ 


- /// 


pressure 
shores 


passage (10), passer 
etc. (5) 

sauce, source 


/// 


- 


naturalist 

natural 

shoi*es 


nationalist (5) 
national (3) 
choux^ce 


h.l 


- /ill 


^ledger-space 


leisure space ( 1 5) , 
leasure space {?.) 
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Table 2.*iyowel substitutions^ 



vowel 
contrast 


Test word 


' Student responses 
; (types and tokens) 


/i/ - /e, 


stiff 


dead (3) t death, 
stef, step, skaft 
steff 




blizzards 

V 


blesers , pleasures , 
bias sets , deserts , 
blessives , pleasant , 
• ei I or X s 


- 


strychnine 


streptine , stateny , 
stocking 




skill 


swell 


/e/ - /ee/ 


eloquence 


allequence etc, (5) 




pressure 


^ passier eta. (9) > 
passage (10). 

* 




inexorable 


inaxable etc. (3) 




ledger-space 


ladder-space 


• 


than 


then (2) 


/a/ - /o/ 


lusts -K 


loss (3), losts (3). 
lost (15) 


/e/ -/ei/ V 


bait 


bet (3).v bed, death, 
leg, beg 




4. VI. 3 Addition 

Th4 addition of phonemes normally occurs .together 
--y^ath-.substi tutions and may be hard to distinguish 
from pure sub'stitutions. Examples: 

dequal - . for decoy 

b] ister? ' for blizzards 

, fuels for f u-se 

^ * n^-^con . £or pigeon 

*We. shall deal with one type of addition which was' 
found repeatedly in the .te'-st examined, i.e. the in- 
correct addition of /X/ after /n/. It occurred in 
the, following cases: 

s-pec j morit (• 1 1 ) , spac cment (?) * ' ^ 

spic foment , sVasch ment , ' • 

' speciement ' , for specimen 

' eli quants y .^lequantes , eli - 
quont , elequants (.2), e^ot^uants , 
elekvents , eloquents ( 2 ) , elo - " , 
quent , alleguents , alacwents , 
elephants § for eloquence 

pi^efit ' ' • for pigpon 

Examples like thVse may indicate that combinations 
of nasal -f homorganic stop function as units; cf.* - 
the substitution of combinations of na-sal homor 
ganic stop referred to in the preceding section. 

Additions are frequently caused by syntagmatic ; 
cjrcumstances , e.g. the addition of /n/ in plngQcn 

pJ geon . ■ Tnis is especially true of the incorrect 
addition of /t, d, s," z/ representing the inflexional 
endingG -ed and see Section ^*1.:}.4 below; 

4.1.1.4 ia^ordoring , 

L'Oir.e ti iner-: 1 he oi'der. o J^ pndii»?mop^ ir invertf?d. Tli'j B 
t;/['C' or cvrca^iL: roJat^'d to i.ho cnhat: of [.^yn ta^'imxi tic . 



substitution and addition referred to in the pre- 
ceding sections. Exainples: 

trade^i for tragedy 

ami nut ion for ammunition 

distans short for distant shores 

More complicated instances are: 

p urtants infacts for pertinent facts 
stigeron perepjrine for straggling pigeon 
du3t and lastes for less than justice 

The following cases involve omission well as 
reordering: 

havened succome for having succumbed 
ensolver ^ for involved observer 

We shall not deal further with reorderings^^ since 
they appear to be comparatively rare. 

4.1.2 Lexical errors ' 

Phoneme errors normally result in lexical errors, 
i.e. a failure to specify lexical items. Phoneme 
errors appear, however, frequently to be caused by 
lexical weakness. It is certainly no coincidence-^ 
that the substitution of /e, 2/ for /i/ occurred par- 
ticularly in the comparatively rare words bli^.zards 
and strychnine , whereas no case of such substitu- 
tion was found in e;g. distant and literary . This 
means that the identif ica cion of phonemes is partly 
based on higher levels of language than phonology. 21 
In this section we shall briefly survey the following 
types of lexical error: omission, substitution and 
addition, 

4.1.2.1 Oiiii ;j3ion 

OmisGion of lexical items forms the largest caterory 
of errors. is to be expected, omissionci occur 



especially in the case of- comparatively rare words, ^ 
e.g. blaz'^ards , slumped , inexorat)le t Omissions 
appear further particularly in the middle of a phrase 
or sentence. The words most frequently omitted in 
rather more closely related to the literary taste of 
1 972 were: c losely , related and literary . Another 
factor which seems to be involved in omission is 
stress. Everything else being. equal, a contfent word 
is more likely to be omitted, replaced or distorted 
the weaker its stress is. A further factor which 
might be significant is the grammatical function of 
^ words. It is conceivable that modifiers would be 
iftore likely to be omitted than heads of constructions 
The evidence is not clear on this point; cf. e.g. 
the examples quoted in Section 4.1»3.3f the end. 

4.1.2.2 Substitution 

As in the -case of omissions, substitutions are more 
frequent if the lexical item is unstressed and/or . 
appears in the middle of a phrase or sentence • This 
may be illustrated by errors in rendering the date 
1 972 (types and tokens): ' 

- 1922 (2), 1962 (2), 1932 , 1902 , 1872 , 
of the 19th century too 

As is apparent from the introductory discussion 
(Section 4.1.2), substitutions are especially common 
in the case of infrequent words. 

In studying substitutions we may find a scale 
of phonological and/or semantic approximation to the 
test word. Examples (the test woi^ds are listed to 
t}ie left): 



mif ran t 



migron 



bike 



falcon 



micron 



vision 



hawk 



micro 



sight 



creature 



c 



2'j 




crow 



craw 



crown 



bird 



couw 



crop 
crab 



hawk 



pur 



falcon 



Errors in the first column indicate an attempt to 
give a purely phonological rendering of the test 
word. Responses in the second column are actual Eng- 
lish words but oemantically inappropriate; those in 
the thii»d column are English words semantically re- 
lated to the test word. As regards the connection 
between these types of responses and the level of 
proficiency of the student, see Section 4«2. 

The follov/ing observations may be made as re^^ards 
the substitution of a lexical item for another: 

a) An infrequent word is usually replaced b^^ a 
more frequent word. Examples: - ' 

stumbled , stepped , stopped for / slumped ; 

stran^lin^;, struggling , 

striding * - for .sto^aggiling 

b) A word is sometimes replaced by another^ word that 
is related to the total context. Example: 

hawk, falcon for crow and 



Errors of the latter kind, as well as errors involving 
the substitution of words which are seiLontic^lly appro- .• 
priate but phonologically incorrect, demonstrate that 
the comprehension of the total context is involved in 
partial dictation. 

In certain substitutions a lexical item is 
Begrnented incorrectly (e.g. of the serve r ^OT observer ) ^ 
iOrrors of tbi:} kind v/i]l be discussed in Jection 
4 . 1.3*1 below* 

In oom.' caiu}s subr^ ti tu tiono aro clearly syntagmatic 
Exanijdt'S : 



migrant 



jiist injustice 


for 


less than justice 


observt^d observer 


for 


involved observer 


Gkillity 


for 


.skill (in skiil and clarity) 


excitement and 


for 


excitement and 


d.i 5 tine tine nt 




distinction 



These instances are related to the reorderings dealt 
with in Section 4.1. 3.? below. 

4. 1 . ?.3 Addition 

The addition of content words, apart from the cases 
of incorrect segmentation to be dealt with'in Section 
4.1 •3.1, is infrequent. Lixamples: » 

the less passioret - for the less passionately 
ly less j nvolved 



involved 



for the pero^^rine for for the falcons 
falcons 

The addition of function v/ords iB the most comnjon 
subcategory; tliis will be dealt wiXh in Section 
4.1.3.5 under grammatical errors. 

4.1.3 Grammatical errors 

The following categories of graimnatical errors will 
be briefly dealt with: errors of segmentation, re- 
ordering, restructuring and errors in morphology and 
the use of function words. 

4 . 1 . 3 • 3ognienta.tion 

Errors of sogm'^^ntation 1:3 the category which perhapc 
m^ont cJearly dcinonstrri tes the active use of grammar 
in partial dictation. This jusiifies a more detailed 
presentation of such erroj\s than will be provided for 
the other categories • KxaJiiples : 
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at be lossy teiiiuorltys , for at below zero 
at blo'ws jts temperature , temperatures 
otten lost his temper 

rathey aiiununition , 
run avery nision 

rescently alarmed 



for run out of ainmuni - 
tion 



for rea'sonable we3 1- 
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rightful 

unirtemporary , untem- 
porary , on the tem - 
porary ( 5) , on a tem - 
porary ( 2 ) , on it tem - 
porar y , on detemporary 

west word , west wood , ' 
west world etc* (many 
examples) 

of appearance 

person in fact 

lastin,^ injustice , 
last injustice (?) , 
just injustice 

having; to come (4 ) , 
having BQ fun , having 
so come 

brif^ht r^L-en blue ' 

of t^i e_ server 

tense scopi t 

c 0 o T free b n au t y , 
cools , fear anj hpauty , 
cooird b>''iat1 OS 

ov<^r a mi 1 lion 

ruin of o XV cnbour e 



for 
for 



armed 



rifle 



only temporary 



for westward 



ior 
for 
for 



of the period 
pertjj^enb facts 
less than justice 



for having nu^.-cumbcd 



fox" brightly plumed 

for observer 

f^'^* telescopj c 

for cruc ' ly ani beauty 

for urban mill ions 
for rura] / road j a 



Examples of incorrect segmentation of Inexorable 
are given in Section 4.1.1.2. As demonstrated by 
the examples, the correct segmentation is far from 
given but must/ be discovered by the student in the 
continuous chain of sound. 

Segmentation errors share certain characteristics 
with substitutions (cf. Section 4.^.2.2): 

a) They occur especially in unstressed , syllables. 

b) There is a tendency to replace rare words by 
more freque-nt one 3. 

c) As in substitutions, we may observe false 
segmentations with varying degrees of ffhono- 
logical and syntactic correctness. 

Two cases of presumably incorrect segmentation 
(and substitution) were especially frequent: 
a) In the test item conveys the vast genocidal 
traredy of the period 44 students wrote a 
. verb; form fn the past te^;ise ( conveyed , con - 
vessed, convinced , convised etc.). 
In the test item lacks the sweep and the 
eloquence 16 students wrote a verb form in ' 
the past tense (usually lacked or liked). 
In the first case, the definite article following the 
verb probably provided 'the basis for the past tense 
form of the verb appearing in student responses, 
thougli contextual factors may also be involved (the 
precedin(^ nenterxces were in the past tense). This ' 
has aloO • ippenod in a minority of the responses in 
the secoiji case; iK^wever, a majority of students 
(46) have here simply omitted the inflexional ending 
of the vcj:b (the usual response was lack or like ) . 



4. 1.3.? Hcordorint-; 

I'urc reo]*(icr } n^: errors are 

hi r> prej^onl;} ti on und 
uvv hi v^f TP 'Hi 0 r the 
fnaln 



very infrequent. Examples: 

for hi s arr/in^;emon t and 
present n lion of the 
fact:-j 



the dedicated equally 
sportsman 

a cross between a 
brightly plumed pigeon 
and a crow 



for the equally dedicated , 
sportsman 

for a brightly plumed 
cross between a 
pigeon and a crow 



Reorderings occur more frequently together with^. substi- 
tutions and other types ol^dev:yttions from the text, 
especially in long test items. Examples: 



for the less passionately 
involved sportsman 

for rather more closely 

related to the literary 
taste of 1972 



the less sportsman 
proposed 

rather more litterally 
related to the taste of 
1 972 ^ rather more 
literally related to 
1972, rather more 
literary near to the 
taste of 1972 



to the tast e of literary for to the lilev^iXj taste 
of 1962 of 1972 



casul rural drearii of 
some rude Arcadia , 
casnue rogrpl 'dream of 
sorn golden acadia 



for casual urban dreani 

of some rural 'Arcadia 



In the last-mentioned test item urban in urban dream 
was repeatedly replaced by rural * ^' However, only one 
instance was found of the replacement of rur al in 
ru ral Af'cadia by urban. 
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4. 1 .3 •'IJ Restructuring 

In errors of res true turi n,_^ the grammatical construction 
is chan;:r'd. Restructurings normally occur together 
With r^uL.^t i t uiioiir. unO/ov aJdi tioiic;. i'lxamiilo;::^ : 



held ])o1o*-vCi] r;overal 



for at belo w ^u^ro 
tempo ra tu rur^ 



his cir ra.rir;ement in 
ft 

prenrniin>: the facts 



I ain not proposed to 

that distance calls 

that provides 

the less passionately 
of all jnsolved 

the sari est kind of 
tragedy 



for his arran/^ement and 
presentation of th e 
facts 

for I don^ t propose to 

for from distant shores' 

for of -providing 

for the less passionately 
involved observer 

for the vast penocidal 
ira.^edy 

froi^en stiff as they for frozen stiff and 
stumblc- d over a stmip slumped o y-er a stump 

The restructuring in the last example occurred in. the 
papers of rr.any students ( as he/ they slumped/stumbl ed 
etc, over ?3 stump/stumb etc . ) . 

Errorc of restructuring often involve chances in 
secnientation; examples have already b^en given in 
Section 4.i/3.r. Restructurings^ are further frequently 
combined with reorderings; for examples see the pre- 
'ceding section. Another category of restructuring 
may appear v/hen test items, especially long test items, 
are "abbrev.] ated'* . Examples of such abbreviations: 



for the urbans (3) 



the lc5^s passioned ob- 



for for the urban millions 

for the less passionately 
involved observer 



servcT- , the less im ~ 
patlonfit o observer , 
the lens panri o nn ted 
obr;c?rvor etc . ( many 
exam}'] otO 

oloso to (i.'iany examples) for closely related to 
succuTf^' to hin for nuc cu inbcd to his 

I)o_j nr nibri t/ ^:/ tojjui poisonod bait 



4 •1.3.4 Morphology 

Under this heading we shall deal with errors which ' 
could be corrected by changing the grammatical form 
of a word. Errors are especially cormnon in the use 
of the inflexional ending -(e)s» Examples of omission 
or addition of -"(e)s: 



ho send , a falcon 
swoop , he exhibit , 
he lack / like 

admiral son 

Cruelty and beauty 
feels / flows / goes / fuses / 
fuexs/ rules etc* 



for he sends > a falcon 
SWOO PS , h€ exhibits , 
he lacks > . 

for admiral ^s son 

for cruelty and beauty ^ 
fuse together 



In the last test item quoted the final consonant of 
the stem fuse was very often interpreted as a combina- 
tion of another verb + the ending --(e)^. The following 
cases of addition of '{e)Sf which were very frequent, 
should no doubt be interpreted as anticipation errors 
(types and tokens): 



his ar r an r-; cfm e n t p an d 
presentation of the 
facts (26), presenta - 
tions of the fac ts (4) 

as potential baits / 
bates for tvie falcons 
(13) 



for his arrangement and 
p resentation of the 
facts 



for as a potential bait 
for the falcons 

s 



Another case of addition deserves to be noted, since 
it occurred very often (42 examples): 



eye for dotal Is 



for eye for detail 



'/he i)robablo explanatjon for this addition is that the 
oorrei^yondxnt^ Sv/edir.h expression woula contain a noun 
in the plural. 

Ajj.irt from oini fusions and additions of -(e)s, the 
foilowi/L- cases of incorrect une of endin^G wui-e noted: 



ERslC 



3b 



a) The form of adjectives and adverbs was repeatedly 
,rende'red incorrectly. Exajnples (types and tokens): 

reasonable well armed for reasonably well armed 
(14) 

passionate involved (13) for passionately involved 

equal dedicated (5) for equally dedicated 

bri/;^ht plumed (4) for brightly plumed 

was trmporarily (2) for was temporary 

sentimentaly or sensa - for sentimental or sensa - 
tion tional 

naturally history for natural history 

an unusually migrant for an unusual migrant 

b) A case of incorrect use of -ed was dealt ,with 
above under segmentation (Section 4»1«3*1)» i*e. 
the use of conveyed etc. for conveys and lacked 
etc. :f or lacks. ;.The addition of -ed also occurred 
frequently in the following instance: 

fused / are fused / is for fuse together 

f used / refuFcd / forced 

together ( 1 1 ) ^ . 

As in the cane of conveyed and lacked etc. , the 
addition is probably syntagmatically conditioned. 
The omission of -ed occurred repeatedly only in 
havin;: succumbed to his poisoned bait , probably 
conditioned by a combination of phonological (the 
following to) and lexical factors (failure to 
identify succumb ) > 

Apart from* cnrcs of incorrect use of endings, there 
vvv cilno, iliough Ic^.s frequently, errors of the folldw- 
ng kj rid ( ty|-ps nnd tokens): 

d Lcl^ no I r.;in (b)f did * for did not run 
not h»ni 

r^Koo I ( 4 ) for r.lio t 

vjnu I d bf: coiiij^ared ( 1 ) for will be compnred 



The lai5 t-mentioned instance seems to be !an example 
of an anticipation error. I 
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A•^•3•3 Function words \ 

Function words are normally unstressed anrl frequently 
strongly reduced. Hence, we can expect tp find many - 
errors in the use of such words. The principal cate- 
gories are: omission, addition and substitution. 
Examples: \ 



a) omissions: 

having' succumbed his 
poisoned bait 

as potential bait 



for having succumbed to 
his poisogied bait 

for as a potential bait 



I don^t propose repeat / for I don* t pnopbse to 

repeat ) 



repeatinp; 

b) additions: 

his arrangement and 
his presentation 

from the distant shores 

the literary taste of 
the 197? (several 
examples) 

c) substitutions : 

the elderly admiral *s 
the exoi 1 emont 

at/jto/ in oontinuous 

b} i x.r.ards 

f or / to / wl 1 h / an for 
p6 tenti al h<i] t 

hayin^^ Muceurnb^-rl of / 
v/i th ' 

(rye' oi' / on / vn th do ta i I 

3 b 



for his arrant^ement and 
— ^ — 

presentatioi^ ' 
for from distant^ shores 



for the literary^ taste 



of 1972 



for an elderly adntlral^s 

,for,' tlieir excitement 

for through continu^pun 
blj zzards \ 

for . a£_ a potent j al b^ i t 



V 



for havin;' ijuccumbcd 



T 

fnr vyv i'ov do l^i j 1 ' | 



Substitution errors are especially frequent. Partial 
dictation would seem to be a particularly efficient 
means of testing the command of function words* 



4.2 LEVELS OF COr^FREHENSlON 

We have seen earlier (cf, especially Sections 4.1. 2*2 
and 4.1.3.1) that .the degree of phonological correctness 
and syntactic/semantic acceptability may vary in in-- 
correct responses. In this context we might talk of 
different levels of comprehension: 

I The lowest leve]. is represented by responses 
which seem to reflect an analysis on the phono- 
logical level only. ' Example: 

lep:islaQes for Ledger-space 

II On a higher Level, the chain of sound has been 
analyzed morphologically and?or lexically, 
though the response is syntactically and seman-*- 
tically incorrect. Example : 

legislates ' for ledger-space 

III On the next level, the response conforms to 
the syntactic rules of the language, but it 
is semantically inappropriate. Example: 
ladder space for ledger^spaoe 

IV On the highest level, the response is syntac- 
tically correct and semantically more appro- 
priate, though it deviates from the text on 
the level of phonology. Example: 

'1 j vi n;-;- space for ledger- space 

Thes^^ lovolr. of comprehension corresponci approximately 
to the sta^:es of error corroction outlined in Fry (1964); 
cf. <'iJ.o the nuotation from Fry (1970) given in Section 
? . 1 . 
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An attempt was made to study the relationship 
between level of .comprehension, as defined above, ^nd 
the degree of proficiency of students, as measured by 
their scores in the test. The following three test 
words, which were very often incorrectly rendered, 
were selected for study: 

pressure , in westward pressure was inexorable 
straggling in swoops on a straggling pigeon 
ledger-space in providing ledger-space for the 

urban millions 
A typical response for each test word and level is 
listed below together with the, number of students who 
provided a response on that level.- The average score 
of the students is given within parentheses (maximum: 
200). 

pressure straggling ledger-space 

.1 passier 8 stragelin 5 legislades' 3 • 

(122) (126) (154) 

II pursue. 1 - legislates 2 

'(lv?6) • (161) 

III Russia 5 strangling 6 ladder space '6 

(133) (132) (141) 

IV passage 10 struggling 18 living-space 16 

(142) . (160) ^ (170) 

According to the evidence, there seems to bo a clear 
difference in proficiency between students v,no hdve 
provided responses on lower levels of cqmprehension 
and students whose responses belong to the highest 
level. The evidence is too scanty to allow any con- 
clusions to 'c drawn as to the mutual relationships 
between the lower levels. The result of our comparison 
agrees with the observation made Ir Angelis (1972) in 
a ^report about errors in a transcription exercise that 
beginning students tended to transcribe with reference 
to the phonetic level only, whereas more advanced 
students attempted to produce a transcription which 
gave a reasonable meaning. 
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4.3 ■ TiiB LIKGUISTIC eVILENCK OF COMPkEHENSION 'ERRORS 
The aim of error analysis is primarily to reveal the 
problems of foreign langi'a^e learners. However, the 
analysis may not only £jrve a pedagogi-cal purpose but- 
may be of great theoretical interest. The errors re- 
■ vealed are then used to support or refute various clai.ns- 
about language functioning.- This is the approach 
re^re^.ented by e.g. Pry Cl964), Cohen ( 1966) , Noote- 
boom (1969), Fry' (1969), Bierwisch (1970) and Fromkin 
(1971). The >/ork barrier! out by Fry>s of special in- 
teroBX m this context, since it deals with the per- 
ception of speech. Fry (1970), p. 49, conclviaed- th'at 
"... there is compelling evi-^ence in favour of the 
theoi-y-of multi-level decoding to be found in the 
correction of errors whi6h goes on - _ speech". This 
conclusion was based on an exai!.ination of er.^ors amo)- 
native speakers, .but it is also borne out by our study 
"of the errors of foreign learners. A detailed analysis 
of coinprehennic.i errors would aJ so make it poosible to 
draw other conclusions about language functioning. . We 
stall list some possible arenas of investigation: 

a) Perceptual confusion among phonemes. The study 
should be based primarily o > purely phonological 
renderings of te^^ words (cf. Section 4.2), e.g. 
eurgeon , erving , irvin , for urban 

urhy 

rnlcT-on , mere, EL^ZSIL' migrant 

mi aomb q 

Is it posiablc to sot up a hierarchy of related- 
ness of /.(rce-'ved phonemes? iiow is this related 
to corresponding articulator-/ hierarchy? 

b) The :;co]-c of reordering errors. What is the ncope 
or rooj-.;-rm': errcj-n ;■,)!<] wtiai doos this imply 
nbc'Ul ur it:: of codi rg': 

c) Antic i p. 1 i.iri v. perseveration errors. In the 

n;;it.rr i.-'l .v'-' li'-ive (.■x;';i.i ncu an i ic i p. t i on errors 
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W5re more frequent than perseveration errorc. 
Would this be true in an examination of a larger 
material? If so, what does this say about 
language functioning?' 

d) Category of errors and psychological charac- 
teristics of learners. Is it possible to relate 
different categories of errors (e.g. errors on 
different levels of compreher^sion or the fre- 
quency of omissions v. substitutions) to psycno- 
logical characteristics of learners? W^at does 
this indicate about the. nature oi linguistic 
compet ^nce? 

In order to ma. it possible to dravy more general 
conclusiors from studies of thii? kind, it woula be 
desirable to analyze errors in the sr^'iie test commi'tted 
by native speakers of a language as well as ^y foreign 
learners of that language with varying source lan^ua^^e 
Da ckgrounds. 



WHAT DOES PARTIAL DICTATION r^ASURE? ' 

It is traditionally assumed- that dictation mainly 
measures sound-symbol correspondences. Cf, e,g. 

"Dictation is primarily a test of spelling," 
(Somaratno 19b7, p. 48) 

"Spelling ond a few matters of inflection 
and punctuation can be tested through dic- 
tation ..." (Lado 1961, p. 34) 

Oiler (1971) demonstrated that far more is involved 
in ordinary dictation than the mere conversion of 
sound to spelling (cf. Section ?.l). This is es- 
pecially true of partial dictation, as described in 
this paper, where the importance of spelling is reduc^ed 
by the scoring system (cf. Section 3*0.^^ The error 
analysis in the preceding sec Lion clearly demonstrates 
that the sturiont niu&t use his knowledge on all levels 
of th-^ Icnguaf^e system in order to^ produce a correct ' 
response/ The attempt to convert a sound impression 
to spelling without an analysis on higher levels of 
Imgurr^e may result in responses of the following kind: 

at be lon.sy temporitys for at below zero tem - 
peratures 

run avory nision for- run out of ammunition 

rule of our caboure for rural Arcadia ^ 

hav an r^^'cund for having succumbed 

In order to provide the correct response the student 
munt have a^jsigrK d a correct syntactic and semantic 
analyric> to the test item, i.e. providing tho correct 
re^^^]-'0)i:.e is i:nio;3sible without comprehension. This 
is: esi rciai ly true of a ])artjal dictation in English, 
due to tlie st7\M).- r(?duction of unstressed syllables 
and th<- CM:..i Lj **.it ed rd a li onshJ p between Hound and 
sp(0 Tin:* . . 



In tests of listening comprehension it is 
generally assumed that the student must demonctrate 
comprehension by providing verbal or non-verbal 
responses of the following kind: answering questions 
based on the message, providing paraphi^ases , following 
directions, etc^ For a survey of different techniques 
of testing listening comprehension, see Carroll (l972). 
It is remarkable that accounts of the testing of 
listening comprehension normally do not include dicta- 
tion (or partial dictation) ; cf, e,g. Lado (l96l), 
p. 204-222, Pimsleur p966), p. 186-194, Valette (1967), 
^p. 47-78, Carroll (l972) and articles in Davies (l96B). 
This is all the more remarkably, since dictation (or 
partial dictation) s'eems to be less vulnerable than 
other testing techniques to the usual criticism of 
listening comprehension tests, i.e, the fact, that 
they tend to measure irtelligerice and memory factors 
as well as "pure comprehension". In his recent survey 
referred to above, Carroll, p. 3, states tha'. researchers 
should investigate "whether it would be possible to de-*^ 
crease the correlation of o^omprchension ability tests 
with intelligence tests by eliminating or reducing 
those elements of comprehension tests that call for 
inferential processes that go beyond sheer comprehen- 
sion**. He further pointfe out that research is needed 
"to see to what extent it is possible to reduce their 
dependence on memory'* (loc. cit.)* Such research into 
"pure comprehension" should include a close investiga- 
tion of dictation techniques. 

Partial 'dictation would thus seem to be a useful 
test of listening comprehension* V/e do not suggest, 
however, that it should replace other testing tech- 
niques. Other techniques Will have to be used to test 
the higher levels of co nprel ..nsion mentioned by Rivers 
(VJ71) and Carroll (^^^?):^^ 

V/e can detect in the r - jccss of perceptual 
construction three stages ... The first 



staged sometimes called "sensing", is a stage 
of rapid impressions, only roughly identified 
and differentiated and is relatively passive 
and receptive* (Rivers 1971, p. 126) 

The second stage is one of identification 
through segmentation and grouping^, (Ibid. , 
F-127) 

... the third stage, that of re^iearsal and/ 
receding of the material, which must take 
. place before what we have perceived enters 
into long-term storage, (Ibid., V* 128) 

If the above analysis is correct , ^testing of 
comprehension involves consideration of the 
tv/o conceptually separable stages of the com- 
prehension process. That is, we would like 
to find out, in a given case, the extent to 
which the individual "correctly" apprehends 
the purely linguistic information tl at is 
"committed" to the message, and also the 
extent to which he "correctly" relates that 
information to some wider context* (Carroll 
1972, P- U) 

Besides being used as a listening comprehension test, 
partial dictation coul& have another important function 
Due to the high correlations with other measui-es of 
foreign language proficiency, it might be used asM 
global estimate of a subject's proficienc'y in a 
foreign la]\^uage; cf. however, the discussion in 
■Johansson (1973)'* the end. 
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^ As pointed out by Oiler, op.cit., p. 255, these 
results refute the conclusions of certain authori- 
ties who have argued that dictation is an inferior 
testing technique, Cf. e.g. Lado (1961), p. 34: 
"Dictation ... appears to measure very little of' 
language." 

2 J^ote, however, that ordinary dictations may also be 
administered in this w^y; see Valette (1967), P- 140 f. 

•5 In comparing partial dictation and the cloze technique 
we only consider the most frequent type of ctoze tept, 
i.e. written tests. liote, however, that partial dic- 
tation is also different from aural cloze tests (e.g. 
. the types used by Dickens and V/illiarns, 1964, or 
Teisach, 1965) "* n tha.t test subjects listen to the. 
complete text and receive a written version with 
bJanks. It would be interestinc to study the relative- 
effectiveness of aural cloze tests and partial dicta- 
tion. 

^ Cf. Carroll (1972), p. 19: **lt [the cloze technique] 
probably depends to a considerable extent o'n inferen- 
tial processes . " 

The choice was t.4ndom with the exception that students' 
considerably older than the average (over the age of 
thirty) were excluded. 

^ V/hen the examiner had indicated that a student's 

recording was too brief, the score was doubled. This 
scoring L^ycten., which differs from that ordinarily 
used in the test, was iised in order to mal<e it possible 
to compute correlations. 

^ As regards tlin relationship betv/een native and foreign 
langua/^e ])rof i ci ency , cf. Gtendahl (1972) and Truus 
(197?)^ 
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^ It is essential to select voiqes which are unfamiliar 
to the students taking part in the test. Findings in 
a recent investigation by Brodkey (1972) suggest that 
familiarity v/ith the voice of the speaker is a major^^ 
variable in comprehension. 

^ I ain grateful^'to FK Stig Olsapn, Department of English, 
Lund, for constructing the second part of the test. 

It has alyo seemed preferable not to make any omissions 
in the firsV few sentences Qf each passage (cf . Appen- 
dix 1 / . A possible improvement is to irvclude two or 
three practice items at the beginning of each passage. 

'^'^ In a survey of v/ork on memory &pan Miller (1963) t 
p. ?10 f . , reports that the average college 'student 
has a -span of about' eight digits. The number of words 
'that can be recalled in a connected text is greater. 
It is suggested, however, that the limiting factor 
may be the amount of information stored rather than 
the total number of items. See further Miller (l956). 

^2 This could be explained by bhe fact that the completion 
of the sentence is given in the ansv/er sheet. 

As shov/n by e.g. leter^on and ^arney (1952), test 
results 'are influenced by the location of the listener 
in the room, even though the room is fairly small 
(9 rows of listeners) and acoustic conditions are 
- favourab]e. Hote, however, that administering a test 
in a language laboratory makes it more artificial. 
Actual foreign language speakers are not often heard 
throu.^^li earphones. Spencer ( 1964 ), who compared test 
re3u]t3>for groups of listeners who v;ere tested with 
either earphoP'^s or loudspeakers, found that performance 
fpr the oari^hone group war. significantly better. Con- 
nequfnt] y , we mu.ct require a high standard of correct- 
njcs in * Gt:] adinini r> te red in i^e lan^^uap.e laboraibry. 

A woi '1 h ii\ 'Jiily bc>on, considered corrc'Ct if it appeared 
in IK'- -rarf't ponlior) in n tent item* Compoiuuis,' e.g. 
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ledger-3pace ,> have been regarded ?i two words. On 
the other hand, numbers have been counted as one word 
(e.g. 197?) 
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Different scoping techniques from the one'^outlined 
here are described in Valette (1967), p. 137, and 
Brodkey (l972), p. 208. 

Note, however, the investigations by Kithlwein (1970) 
and Angela's (1972). Of. also the work by Fry referred 
to in Sections 4.2 and 4.3. 

^ In this brief survey no consistent attempt is made " 
; to iden^tify the causes of the ferrors. A great number 
of them, e.g. phoneme substitutions, are due to source 
language interference. In ot.he'r cases, e.g.' reorder- 
ing errors, the reason is usually of a more general 
nature. 

The evidence offered by spelling is especially diffi- 
oxxlt to interpret in this case. Only clear cases have 
been included. 

These errors are <Qf particular interest^ since they 
illustrate that perception and production problems 
may not be identical • Swedish students have i\o diffi- 
culties with the /i/ - /e, a/ contrasts in speaking 
English, though the examples given (and further 
examples in other dictations) indicate such a problem 
in perception. 
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The substitution was also found repeatedly in;a 
frequent word ( stiff ). The probable explanation for 
the errors is that this word occurs m a test item 
where sevei:al words were often omitted or incorrectly 
rendered. 

2^ CS. Fry (1964), p. 175. 

2^ Thin interpretation is supported by the fact that 
some students wrote the indefinite article instead 
of the dcfinitn article after the verb form: conveyed 
(etc.) a insleafl of convey n the . 
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Note, for example, the substitutions in distant shores 
(cf. Section 4* 1.1.2, the end); the perseveration error 
distant nhort occurred once only, whereas the anticipa- 
tion error dlstgnce shores occurred seven times. 

The Importance of spelling cannot, however, be elimi- 
nated completely. For a discussion of comprehension 
V. spelling, errors in dictations, see KuhlWein (1970)» 

In testing listening pomprehension in a foreign 
languagt.' it seems desirable to concentrate on- the 
lower level of comprehension that can be measured 
by partial dictation* The higher levels mentioned 
by Carroll and 'Rivprs are probably the same in the 
native and the foreign language. The relationship 
between comprehension in the na.%ive and the foreign 
language should, however, be subjected to a detailed 
examination. n 
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APPENDIX 1 : THE TEST 

The test consists of two passaf^es presented for 
partial (iictation. The first passage was recorded 
by a -^native speaker of American English, the second 
was a recording from the British radio. The test 
was administered in a language laboratory. Students 
received the following instructions: "Listen carefully 
and fill in the blanks in the text. The tape will 
stop at each //." * 

The text of the two» passages will be given below. 
Portions to be filled in by students are underlined. 
For ease of reference, test items are numbered. 

D[ictation] 1 . Book review: "The Fetterman Massacre" ^ 

by Dee Brown. * 
The Fetterman r4assacre is the story of Red Cloud's com- 
pletely viqtorious ambush of 80 soldiers of the United 

ites army in December 1866. Red Cloud, commanding 
armies of Sioux and Cheyenne, decoyed ^ troop of 80 
men from Fort Ihil Kearny on* the Montana road. No 
one returned alive. The man who took the news of the 
'^qiassacre to the head of the telegraph near Fort Laramie 
was Portugee Phillips who, (l) at below-zero tempera - 
tures and through continuous blizzards //, rode 236 miles 
in fpur days, xortugee Phillips survived. The horse 
died. Captain Brown and Colonel Fetterman, obviously 
by agreement r (?) shot each other to avoid capture //* 
The Indians (3) had very few rifles //,- the United States 
soldiers (4)- were reasonably well armed //. They did not 

(5) run ont of ammunition //. One officer was found 

(6) frozen vStiff and slumped over a stump //. His body 

(7) was pj orcpd by ^6 arrows //. Red Clo^^d's (8) vie to ry 
wan complete //. It was, of course, (9) only temporary //* 
The Montana road was opened af^ain within ten years. 

(10) We.stv/n rrI prrr.nuT'o wan inexorable //. Dee Brown, 
as in Bury ^^y H(?nrt at V/ounded Knee, (ll) conveyB the 
va:;l irh')"\^\ \ \ i vrajj^dy of the ix-riod / /. Heisnot 
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(12) sentimei^t-al or sensational //. He draws together 
(13/ the pertinent facts with sl<^il] and olarity //. 
In a sense he lets the facts tell the story, but to 
say this is (14) doiiifi him loss than .justice //. It 
is (1-5) his arrangement and presentation of the facts // 
that gives both books "(16; their excitement and dis - 
tinct j on / / . It is possible that some readers may think 
that Dee Brown' (17) lacks the sweep and the eloquence /'/ 
of the great American historian Francis Parkman but he 
aas an eloquence of his own {'{^ rather more closely 
related to thg literary taste of 1972 //. and I suspect 
that in , the future it wiPl oe with writers like Park- 
man that Dee Brown (1?) will be compared //. 

Dfictationl ? . Book review: "The Seandaroon" 

by Henry V/illiajnsor. 

This^ tjook is about somp ver;y unusual . relationships , 
not betv/een men and women nor even between men and 
men, but between men and birds. The workpeople in 
the sn?a]l town of Thirby ^in North Devon keep raCT.ng'^ 
pigeons. That sport has made them deadly enem^ies of 
the peregrine falcons, which have lived and hunted 
along that stretch of the Devon coast for a thousand 
summers. The falcons swoop on the pigeons as they 
return Lome but Sam Baggott y'^' keeper of the Black Horse 
Inn and a /dedicated pigeon racer, has his own deterrent 
againr^t ^^they bloody hawks**. He ( 1 ) sends up decoy 
bircis impregnated^ with strychnine //, and dances for 
joy when the falcons tumble out of the sky, (?) jiaving 
suc^^-uuibed to hi 51 poisoned bait //. The Scandarcon 
itself is a (3) rather ununual mj^^rant from distant ' 
shores//, something ef a (4) brightly plumed cross 

ilL< i^ri a pi^:enn and a crow //. ^ Its arrival in Thirby 
in gri^^led witli considerable interest. - Sarn Baggott 
(5) lUot3 after it a5. a ]>otential bait for the f .Jconn//> 
The local doctor' rc/^'jrds it with great interest (6) as 



54 



a natuial hi ntory npoclmen //* But the Scandaroon 
eventually becomes the property of (7) an elderly 
admiral^ s youn^ son //. That, of course, is only the 
Ue/^innin^ of the story, and since it is rather a good 
one (8) I don^t propose to repeat all of 'it h.ere //> 
In this short novel, set just after the First ^^rforld 
</ar, Henry Williamson presents us with several con- 
trdS-^'n^ viewi'. of the English countryside — that of 
^9) tl_ ^dicated naturalist //, that of (lO) the 
equally r^odicated sportsman // and that of (ll) the 
' ^ens passionately involved observer //. Henry William- 
son is not a sentimental nature writer. He knows. the 
countryside and its people too well to lapse into the 
^12) casi^al urban dream of some rural Arcadia //. He 
recognizes that (13) cruelty and beauty fuse o^ether // 
when a peregrine f^^lcon (14) swoops on a strangling 
pi,:eon //. In his novels (15) he exhibits a telescopi c 
eye for cletail //, and one feels that he cares n.ore too. 
Our concern for the environment is essentially a social 
concern. It derives from the social problem (16) of 
brovidim ^ le d^r;er-space for the urban millions / / . 

""he students listened to the recordings only once and 
were i;iver\ a few minutes- for final revision. 
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